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ABSTRACT 



This paper reviews the efforts of the Idaho Council for 
Technology in Learning to provide consistent and thorough standards for 
planning for educational technology, presents keys for meeting those 
standards, and offers suggestions for using these keys to successfully 
implement and account for planned technology use in the curriculum. The 
planning process for educational technology is described, including: 
vis ion/miss ion statement and needs assessment; goal definition; instructional 
objectives; development and delivery of instruction; and evaluation of the 
instruction and student achievement. The following requirements for planning 
the evaluation of technology integration in the curriculum are addressed: 
describes quantitative and qualitative assessments to evaluate the effects of 
technology integration; details the relationship between local and state 
goals and instructional objectives, and measurement and assessment 
procedures; outlines plans to correlate results to the amount, quality, and 
length of integration into the curriculum; includes the details of gathering 
longitudinal and pretest-posttest data; details collection, organization, 
analysis, and reporting of measurement and assessment data; and includes 
schedules, funding sources, and budgets for evaluation. (MES) 
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Abstract: In recent years, the providers of federal, state, local, and private iunding for 
educational technology increasingly require more information aiKl justification before funds 
are released Planned expenditures must now be tied to stated educational goals, objectives, 
and standards, and funding providers are requiring some form of evaluation report to help 
determine the impact their dollars have made and to justify future funding. This papc£ reviews 
the efforts of the Idaho Council for Technology in Learning to provide consistent and 
thorough standards for planning for educational technology, keys for meeting those standards, 
and offers suggestions for usmg these keys to successfully implement and account for planned 
technology use in the curricuhmL 



Introduction 

To facilitate the use of educational technology in Idaho public schools, the Idaho State Legislature 
created the Idaho Council for Technology in Learning (ICTL) in 1994. Since that time, the ICTL has been 
chaired by elected members of the state legislature and is madft up of educators at all levels fiom across the state 
(Idaho State Department of Education, 1996, p. ii-iii). The legislation directed the Office of the State Board of 
Education (OSBE) to develop a statewide educational technology plan and required that each school district 
submit a district technology plan for ^>proval by the Idaho State Department of Education (ISDE). 

During the 1995-1996 school year, each district submitted a district technology plan. These covered 
implementation of technology during the years 1995-2000. In January 1996, the ISDE, in conjunction with the 
OSBE and ICTL, published Connections: A Statewide Plan for Technology in Idaho Public Schools (Idaho 
State Department of Education, 1996). The term for the district and state technology plans is approaching its 
end. All district technology plans and the state technology plan require iqxlating du^g the 1999-2000 school 
year. To provide a statewide "thorough and consistent standard (Idaho Council for Technology in Learning, 
1998)” for all technology plans, the ISDE published the District Technology Plan Evaluation Rubric in Spring 
of 1999 (Idaho State Department of Education, 1999). 




Why Technology Planning? 



The district and state technology plans are important documents for the following reasons (Ward, 

1999): 

• Technology plans document, in writing, the ties between technology use and state and local goals, 
objectives, and standards. 

• Outline staff development and plans for integration of technology into the curriculum. 

• Include evaluation plans to determine the effectiveness of technology integration plans. 

• Provide a fiamewoik to siqjport sustained federal, state, and private funding for educational 
technology. 

District technology plans are kept on file by the ISDE to use as references and justification of state 
technology funding. Similarly, the state technology plan is kept on file by the U.S. Department of Education 
(USED) to support federal funding programs. Private grants are also siqjported by and related to the state and 
district technology plans. 
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In recent years, the providers of federal, state, and private funding require much more information and 
justification than that required when plans were first developed in 1995-1996. Not only are planned 
expCT^tures required to be tied to stated educational goals, objectives, and standards, but funding providers are 
requiring seme form of evaluation report to help determine the impact their dollars have made and to justify 
future ^^g. Adequate planning has become much more complex, and can no longer be completed by a 
single in^vidual. Rather, representatives firom all stakeholders - administrators, teachers, students, parents, 
co mmuni ty members, business leaders, etc. — are needed to participate in the p lannin g process to provide broad- 
based support for the plan. In addition to broad-based support for educational technology, successful 
implementation of educational technology in the curriculum requires several other key elements: (a) a thorough 
ne^ assessment, (b) effective instructional objectives, (c) consistent, ongoing evaluation, and (c^ periodic 
review and revision. 



The Planning Process 

Planning for educational technology is cyclic in nature, beginning and ending with an evaluation of 
where the district or state currently is and the goals the organization is attempting to reach. The planning 
process is influenced by the vision/mission statement of the district or state educational agency, and is finnly 
rooted in the needs of the individual district or state (see Figure 1). 




Figure 1: The Planning Cycle 

1. Planning begins with a vision/lnission statement and a thorough needs assessment. The 
vision/mission statement of the district dr state gives direction to the needs assessment, which in 
turn ^y influence the vision/mission statement as needs are identified. The needs assessment 
describes the current status of technology (the initial state) and the desired status (the desired state) 

(Gagne, Briggs, & Wager, 1992). The difference, or “g^” between the initial and desired states 
identifies the needs. 

2. From the identification of needs, goals are defined. Goals describe what is needed to close the gap 
between the imtial state and the desired state identified in the needs assessment. Goals are general 
statements identifying the direction for the district or state to proceed 

3. Instruc^onal objectives are critical to direct the curriculum and to complete the achievement of the 
educational goals. Objectives are measurable, attainable, understandable, and time-based 
Objectives should: 

• Identify the content to be included in the curriculum. 

• Suggest a teaching methodology and the proper tools and aids needed to present the 
curriculum. 
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• Assist in the formulation of the means of evaluating student progress and achievement. 

4. The instructional objectives drive the development and delivery of the instruction. Selection of 
the content, teaching methodology, delivery system and technologies, and testing methods are 
dependent upon the instructional objectives. Thus, in the context of this paper, the instructional 
objectives drive the technologies. 

5. Evaluation of the instruction and student achievement is dependent i^n the instructional 
objectives and the instruction delivered to the students. While there are many purposes in giving a 
test or other assessments (Linn & Gronlund, 1995), evaluation conducted at the end of an 
instructional unit is useful to determine student understanding, achievement, etc. The results of 
these tests may also be used to give insight into instructional effectiveness and usefulness of the 
teaching methodology and tools. It is important to note that the evaluation process may be used as 
a springboard into, or even as part of, the next cycle of needs assessment. 



The Evaluation Component 

Evaluation of student achievement is inseparable from the instructional objectives. The instructional 
objectives give direction to the instruction and mark the intended learning outcomes. Measurement and 
assessment determines the extent to which the objective has or has not been met. 

The Idaho District Technology Plan Evaluation Rubric (Idaho State Department of Education, 1999) 
sets the requirements for planning the evaluation of technology integration in the curriculum: 

♦ Measurement and assessment describes quantitative and qualitative assessments to evaluate the 
effects of technology integration in the curriculum. 

- Details relationship between local and state goals and instructional objectives, and 
measurement and assessment procedures. 

- Outlines plans to correlate results to the amount, quality, and length of integration into the 
curriculum. 

♦ Includes the details of gathering longitudinal and pretest-posttest data. 

♦ Details collection, organization, analysis, and reporting of measurement and assessment data. 

♦ Includes schedules, funding sources, and budgets for evaluation. 

The above requirements are intended to provide standards for planning an evaluation of the impact of 
educational technology on the curriculum. This standard was reviewed by the International Society for 
Technology in Education (ISTE) and approved by the ICTL (Idaho Council for Technology in Learning, 1999). 
These requirements must be met with an educational evaluation conducted either by district personnel, by an 
external independent evaluator, or by a combination of both. Because district and school administrators and 
faculty are practitioners rather than researchers, the ICTL has made no requirement that evaluations be 
conducted as experimental research with modeling and hypotheses testing, experimental and control groups, 
advanced statistical procedures, or other research methods. Instead, educational evaluation revolves around 
using those existing nieasurement instruments already in the classroom to describe the irapaci of educational 
technology on the curriculum. 

Much of the information needed to evaluate projects included in a district technology plan is already in 
place in each district. Most teachers give some fonn of evaluation at the conclusion of major units of 
instruction. Additionally, statewide and standardized tests are administered systematically to all students. To 
complete the evaluation of the integration of technology at the district level, the existing measurement results 
need to be interpreted to determine the merits of the use of technology. There are num^us methods to 
accomplish this. Examine each bulleted statement in the rubric standard above: 

Measurement and assessment describes quantitative and qualitative assessments to evaluate the 
^ects of technology integration in the curriculum. Teachers, schools, and districts are not limited 
to quantitative measures only. Other measures, such as questionnaires and surveys, self-reports 
and interviews, and affective measures may be included as needed to accurately describe the 
effects of the technology in the curriculum. 

2. Details relationship between local and state goals and instructional objectives, and measurement 
and assessment procedures. Evaluations are inseparably tied to the instructional objectives, which 
in turn are supported by local and state goals. 
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3. Outlines plans to correlate results to the amount, quality, and length of integration into the 
curriculum. Three broad factors impact the effect the integration of educational technology will 
have on any curriculum: (a) the amount of time spent with technology in the classroom, (b) the 
quahty of technology use by the students and the teacher, and (c) the length of time individual 
teachers and students have been using educational technology for personal and academic purposes. 
Comparing these three factors with measures of student performance will yield insight into the 
effect that technology is having on the curriculum. 

4. Includes the details of gathering longitudinal and pretest-posttest data Analysis of InngitiiHmal 
measures may be as simple as con^aring the results of student measures on this year’s tests with 
the r^ts of last year’s, next year’s, or the next three or four years’. Currently, teachers 
occasionally include a pretest on certain topics prior to presenting the instruction. The evaluation 
plan may well include an expanded role for pretest-posttest measures. As this is a planning 
process, it is relatively unimportant that a teacher, school, or district does not have longitudinal or 
pretest'posttest data in place. Instead, it is much more important that plans for collecting such Hata 
are included and completed. 

5. Details collection organization, analysis, and reporting of measurement and assessment data 
Reports are required by all providers of educational technology funding. As with all evaluation 
reports, the results are first described, then a judgment is made as to the worth or merit of the 
educational teclmology, teaching methodology, or curriculum project. The data will need to be 
collected, compiled and organized, analyzed, and placed into a report to the grantor. Analysis may 
be as elementary as descriptive summaries such as measures of central tendency, variability, and 
correlation, or as complex as advanced statistical procedures such as multiple analysis of variance, 
analysis of covariance, or non-parametric procedures. 

6. Includes schedules, folding sources, and budgets for evaluation. This part of the rubric criterion 
guides planning to answer questions such as (a) when will the measures be given and the data 
collected, (b) how is the data going to be compiled and analyzed, (c) how much will this process 
cost, and (d) fiom where will the money come? 



Annual Review and Update 

To ensure that technology plans remain current, each state and district technology plan must be 
reviewed and iqjdated oil a regular basis, at least annually. The dangers of failing to regularly review and 
upd^e technology plans include placing administrators in the position of (a) relying iqxm fimHing which has 
expue4 (b) tmssing the opportunity to ^ly for new sources of funding, and (c) depending iqxm goals and 
objectives which are outdated or no longer valid. Annual reviews and iqidates allow the cyclic planning process 
(Fig. 1) to proceed naturally. Each review and iqxlate includes a needs assessment, with a description of the 
cur^t or initial state of educational technology, and a description of the gap between the initial state and the 
desired state. Annual review and iqidate allows realignment of goals, objectives, curriculum development, and 
evaluation, all based iqxm the mission and documented needs of the district and state. 
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